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Abstract 

An alternative model to measure simultaneously scientific and financial 
performances of scientific activities is proposed. This mathematical model 
focuses only on the final scientific outcomes in each fiscal year to gurantee the 
objectivity. The model is suited for the purpose of immediate and quantitative 
evaluation needed by policy makers to make decision in the subsequent fiscal 
year. The model can be applied to any branches of science, while it is also 
adjustable to varying macro-economic indicators. This enables the policy 
makers to evaluate equally scientific activities in various fields of science. It 
is argued that implementing the model could realize a fair, transparent and 
objective reward and punishment system in any scientific activities in order 
to improve both individual and institutional performances. The model also 
enables an automatic evaluation embedded in any scientific databases either 
in the local system or over the net. 
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1 Introduction 



Management is an important aspect of human-being and its activities, including any 
kind of scientific activities. Management as the regulator and also the executor of 
regulation needs appropriate tools to implement the existing regulations. Regulation 
has been created as a common norm and commitment which should be followed by 
all (individual and institutional) fellows in order to establish a mutual relationship. 
Since mutual relationship is a crucial point to realize common purposes of all involved 
fellows and motivate them to work together. 

In the context of scientific activity, scientific management plays an important 
role, much more than another non-scientific (bureaucracy, business, etc) activities. 
This reflects the nature of scientific activity which is strongly based on the indi- 
vidual with unlimited degree of freedom. Because independency and freedom are 
necessary conditions for any scientific activities. On the other hand since a scientific 
activity is mostly supported by public fund, all scientific fellows and its activities 
should be accountable for public. In a real life, however fully transparent, easily- 
understandable and accountable scientific activities are often difficult to be realized. 
This is moreless due to the nature of scientific activity which is in most cases invisible 
and unpredictable. Fortunately, in contrast with non-scientific activities, scientific 
activities are always supposed to generate objective and measureable outcomes in a 
period of duration. 

This means there is an urgent niche on a specific tool to measure scientific per- 
formance based on the scientific outcomes. Because scientific outcome is the only 
element which is measureable. Moreover, performance measurement is not only lim- 
ited to scientific performance, but also takes into account its economic potential. 
So far, scientific activities are almost justified by the aspect of economic potential 
using the method of cost-benefit analysis [HE]- While the scientific performance is 
measured naively based on the scientific outcomes. These methods clearly separate 
scientific and financial aspects, although both aspects are closely related each other. 
More than that, in daily practice it is hard to measure the objectivity on cost-benefit 
method since it adopts somehow absurd references as future potential which is yet 
unpredictable. 

It is also known more complete method as scientific and technical human capital 
(STHC) [ISlElElElIHlISlIinilll] which observes a lot of aspects. Though the 
method looks ideal, this model is very complicated and involves a lot of subjec- 
tive parameters. This reduces the accuracy and validity of the method as an easy, 
transparent and objective measurement tool. 

Therefore it is clear that as long as concerning scientific activity, performance 
should be measured based on the achievement of scientific outcome without consid- 
ering its process. Inversely, this point makes scientific activity is easy to measure 
and quantize. Motivated by this fact, I propose an alternative tool in this paper 
called the Scientific and Financial Performance Measure (SFPM) Model. 

The paper is organized as follow. In Sec. [2] all assumptions introduced in the 
model and its theoretical aspects are given, followed by an example on how the model 
should be applied in the field of physical sciences in Sec. El Before concluding the 
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paper, a detail quantitative analysis is described in Sec. HI 

2 Theoretical framework 

Now let us first discuss the assumptions required in the model. As mentioned 
above, the first assumption in the model is all measurements are based only on 
scientific outcomes regardless its process. The scientific outcome itself is defined as 
: all outcomes generated in a scientific activity which have been recognized by 
independent third parties in a form of either scientific documents or other real 
activities. 

Secondly, the measurement is done in a year basis, i.e. it takes into account all 
scientific outcomes in a fiscal year. This assumption is required since the tool is 
intended to measure the performances compared to the total budget granted in a 
fiscal year. 

Next assumption is, each outcome is ranked based on its "difficulty to accom- 
plish", and is then assigned with an appropriate scientific point (Sp) based on its 
"scientific weight" representing the "scientific importance". The order number (No) 
of all relevant scientific outcomes must be in order without duplication. On the other 
hand, the scientific point of an outcome may be the same with another neighboring 
scientific outcomes, but it must be smaller (greater) than another outcomes with 
different points above (below). This differentiates scientific outcomes in term of 
its financial contributions though the scientific importances might be comparable. 
Determination of the orders and the points of scientific outcomes may differ depend 
on the nature of each field of science. 

Further, it is also assumed some parameters as maximum scientific point {Pm), 
descending rate of scientific point {Pd, in percents) and total scientific point treshold 
per-scientist (Pt)- These parameters should be the same for all fields of science. 
This method then enables a universal evaluation and comparation among different 
branches of science. It should be remarked that the absolute value of scientific point 
itself is less important, because it only represents the scale of discrepancies among 
scientific outcomes. Once the maximum scientific point and its descending rate have 
been determined, a series of available scientific points for each scientific outcome can 
be obtained through the formula, 

Sp = {Pm, Pd X Pm, PI ^Pm,--- , Pl"""^ x Pm, Pi"" x Pm] , (1) 

where no denotes the number of relevant scientific outcomes in a field. Remark 
that one should take the integer of (S'p)j for the sake of simplicity. Concerning the 
appropriateness, it is natural to restrict the scales of parameters for instance to be 
in order of, 

Pm > 100 , Pt > 100 , Pd = (50 ~ 90)% . (2) 

if one puts the minimum value of Sp should be greater than 1 and no > 10. Namely 
if one takes Pm = 10 in this case, then the number of available {Sp)i is too small 
compared with no and leads to a difficulty in assigning the scientific point for each 
relevant scientific outcome. This will be clarified through an illustration given in 
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Sec. El While the parameter Pm works just as an overwhole scahng factor, it should 
be remarked that Pt and Pu are not absolute and subject to further detail analysis. 
However, a general prescription to determine these parameters quantitatively will 
be discussed in detail in Sec. IH 

Economic aspect related to financial performance is represented by the economic 
coefficient {Ce) which holds for all branches of science in a national scope. This 
parameter should be determined initially, and thereafter can be made varying au- 
tomatically related to the macro economic indicators as inflation, economic growth, 
currency rate, etc. 

Finally, using all assumptions introduced above one can consider the ratios to 
measure the scientiflc and flnancial performances. For this purpose, I propose the 
following formulae. 



to represent the ratio of scientiflc performance with np denotes the number of sci- 
entists involved in the collaboration which generates the outcomes and Qo is the 
quantity of each scientiflc outcome. On the other hand, the ratio of flnancial per- 
formance is given by. 



where Bt is the total budget granted to the activity. From these equations, it is 
clear that Rp is related directly to the scientiflc point and the order number of each 
scientiflc outcome. 

Of course the flnancial performance here measures only the "indirect" flnancial 
outcomes generated in a scientiflc activity or by a scientist in a flscal year. However 
incorporating the "direct" flnancial outcomes, if any, is rather trivial, that is just 
adding it up to i^i?. This means the total ratio for flnancial performance becomes. 



where Fq is the total amount of direct flnancial outcomes in the same unit as Bp 
and Ce- 

As shown in Eq. ([3]), the model ignores the weight of each member in a scientiflc 
collaboration or institution which generates the scientiflc outcomes. This means, 
every member is awarded the same scientiflc point. This simpliflcation is taken to 
avoid further subjectivity in the evaluation. However, this point might be relevant 
only when one evaluates the performance of individual scientist. 

Now we are ready to apply the model in a speciflc fleld of science to get the 
feeling on how the model should be applied and could be usefull. 




(3) 





Rp = Rp + -TT- , 

JDp 



(5) 
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3 Application 



From research management perspective, the model suggests two levels of regulators 
to keep the fairness and objectiveness in determining all parameters introduced 
above, that is 

1. The official bureaucracy with an authority on scientific activity. 

The management in this level is responsible for determining the values of global 
parameters which hold for all branches of scientific activities, i.e. Pm, Pd, Pt 
and Ce- 

2. The relevant scientific community. 

The scientific community in a specific field is responsible for determining the 
order and assigning the appropriate values of scientific point according to its 
order for all relevant scientific outcomes in the field. Because these parameters 
are unique for a specific field. 

Once all parameters are fixed, the system is ready for evaluating previous scien- 
tific activities and also decision-making of future scientific activities as well. Here, 
let us illustrate and apply the model in the field of physical sciences. Because the 
global physics community has already several comprehensive databases comprising 
a lot of scientific outcomes available on the net which are very usefuU in this study. 
Taking simple statistics of the published papers in peer-reviewed journals, confer- 
ence proceedings and so on, it has been found that concerning relevant scientific 
outcomes in the field as shown in the second column in Tab. [H the appropriate 
scale for maximum scientific point should be Pm = 200. Again it does not matter 
if one takes 300 or even 400 for Pm, since it only refiects the whole scale of evalu- 
ation. The relevant scientific outcomes listed in the table are all kind of outcomes 
retrieved from three major databases in physics [121 [131 HI]- Putting for instance 
the descending rate Pd = 75% and using Eq. ([T]), one obtains a series of available 
values for scientific points, 

Sp = {200, 150, 112, 84, 63, 47, 35, 26, 19, 14, 10, 7, 5, 3, 2, 1} . (6) 

Assuming the scientific points are taken as written in the third column and the 
economic coefficient has been namely taken to be US$ 100, one can directly calculate 
the financial points {Fq) using the convertion formula for a single outcome, i.e. 
no = 1, 

X _ Ce X {Sp)i 

The results are written in the last column for the order numbers and the scientific 
points assigned in the first and third columns in Tab. [H 

Utilizing Tab. [Hand Eqs. ([3]) and (jlj), one can immediately calculate the whole 
performance of an individual scientist, a single scientific project and a scientific 
institution using their real outcomes in a fiscal year. Since everything is simply 
mathematics, once the global parameters and the order of scientific outcomes for a 
specific field have been determined, the rest can be done automatically to get the 
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Table 1: An example of relevant scientific outcomes in the field of physics science, 
the scientific points and the financial convertions for Pm — 200, Pd = 75% and 
Ce = US$ 100,-. 



total score. For example if a physicist, granted with a totally US$ 5,000 research 
fund, has published two papers in major international journals and one book through 
an international publisher, then the scientific and financial performances in that 
fiscal year become, 

(150 X 1) + (112 X 2) 
^5 = ^ r:7^ xl00% = 109%, 

i X z5U (Q\ 

= (3.7S°X1) + (M00X2) ^,„^„^j3g^„_ W 
5, 000 

for Pt — 250. In this case only the indirect financial outcomes have been taken 
into account since the direct one is absent. The same procedure should be taken to 
obtain the performances for an institution or a single project. 

For the order of scientific outcomes and its scientific points one can rely on 
the common sense recognized by relevant scientific community in the field. So the 
remaining problem is how to reduce the subjectivity in determining the global pa- 
rameters. This problem stays on the official bureaucracy as mentioned above who 
might not be familiar with the scientific standards. In the next section a general 
prescription to deal with this problem is discussed. 
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4 Further analysis 



At this stage, one can obtain easily the correlation between the scientific and finan- 
cial performances using Eqs. ([3]) and (jlj) as follows, 



for each outcome. The slope is determined by the angle 6i which satisfies the relation. 



This correlation function is depicted in Fig. [T]for the 1st till the no—th scientific 
outcome with np = 1. The horizontal length for each outcome is determined by 



The allowed region in the Rs — Rf plane is given in Fig. O One can roughly 
divide the region into two areas, the upper and lower areas from the treshold line. 
The treshold line shows the equilibrium condition where the scientific and financial 
performances are completely equal, i.e. tan 6'treshoid = 1- It can be argued that this 
line might be used to determine whether a scientific outcome relative to its total 
budget is categorized as applied (financial oriented) or non-applied (scientific ori- 
ented) outcome. This mathematical definition of applied and non-applied outcome 
is new and provides a new way to categorize the outcomes in any scientific activities. 

From this point of view, the definition of "applied" and "non-applied" are rather 
mathematical than subject to wide interpretation as the conventional view. This 
means, as experienced in daily life, the interpretation of applied and non-applied 
outcomes are non-trivial and dynamic depending on how much the total budget (-Bt) 
and how many person are needed to generate the outcomes. This result generalizes 
common sense of "applicability", but it is actually more natural. Since something is 
"applicable" if someone is able to accomplish it with less budget than another ones 
which require more regardless how much the potential revenue can be obtained in 
the future which is always the subject of subjectivity. 

Moreover as shown in Eq. (JTOll . this result also proves quantitatively that the 
number of scientists in a collaboration is proportional to the level of "applicability" 
of their outcomes. Actually one can observe that, for instance theoretical studies 
which are less applicable are generally worked out by groups with less people than 
the experimental ones. 

On the other hand, the treshold line could be utilized to determine the values 
of Po- One first puts a specific scientific outcome, which can be clearly categorized 
as either applied or non-applied outcome for a reference value of Bx, to be on 
the treshold line. Thereafter, another scientific outcomes can be put into one of 
two regions relative to the previous one. The parameter Pd then can inversely be 
extracted such that all outcomes stay on the desired regions for given values of 
Pm and Pt- Pt can be obtained in advanced through statistic analysis on some 
existing databases of scientific outcomes in the related field. This prescription at 
least would significantly reduce the ambiguity in determining the global parameters 
as mentioned in Sec. O 




(9) 



tan 6i 



Ce^ Pt ^ np 1 



(10) 




{Rs), = {PDr^{PM/PT). 
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Figure 1: Correlation between Rp and Rs 
for each scientific outcome per-person. 




non-applied region 



Figure 2: Treshold between the apphend 
and non-apphed sciences in term of its sci- 
entific and financial performances. 



5 Conclusion and discussion 

A new alternative tool, the SFPM Model, to evaluate scientific and financial per- 
formances has been discussed. In the model, a simultaneous relation between scien- 
tific and financial performances has been formulated assuming that the quantitative 
scores should be extracted only from the scientific outcomes. The model solves 
a crucial problem on how to measure simultaneously both scientific and financial 
performances of scientific activities in various fields. It provides a simple tool for 
immediate evaluation which is in practical daily management urgently needed. Since 
the model is based on the completely quantitative measurements, it could avoid any 
ambiguities and then guarantees the objectiveness of evaluation process. A sus- 
tainable evaluation utilizing the model could also measure and integrate long-term 
scientific and financial performances in complement with the other known evaluation 
methods. 

Here, I list several advantages of measurement tool based on the SFPM Model, 

• Since it is based only on the scientific outcomes, the objectivity and trans- 
parency of measurement can be guaranteed. 

• A single year base method makes the evaluation process and decision-making 
for next fiscal year easier, since the result refiects an up-to-date real condition. 

• In long term, the whole annual evaluations of each fellow can be compiled to 
implement better compensation system. For example, the evaluation result 
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can be used as a basic reference to distribute and allocate human resources 
and funding to each individual or institution. 

• The same tool can be used to evaluate the advisability of incoming proposals 
in term of the promising targets claimed in. 

Implementing the SFPM measurement tool consistently and continously in long 
term for each individual, scientific project and institution could generate perfor- 
mance indicators in each level. This has a great potential to help identifying the 
fundamental problems related to scientific activities in a regional or national scale. 
Combining the result with a consistent compensation system could also improve the 
whole scientific performance. 

Most of the parameters introduced above are not absolute and only indicate the 
scale, which make them easy to be determined without requiring deep considera- 
tion. However, more serious consideration is still required for few of them, which 
especially constitute all fields absolutely as descending rate of scientific point (-Pd) 
and total scientific point treshold per-scientist (Pt)- The parameter Pt can be de- 
termined in a comprehensive way by for instance taking the average of all scientific 
outcomes generated by scientists around the world. The data can be retrieved easily 
through the existing databases available on the net. This result further can be used 
together with the treshold line method described in Sec. H] to determine quanti- 
tatively the appropriate descending rate Pd- Therefore, further research utilizing 
available databases providing global [121 [131 HH IE] and local [I6j scientific outcomes 
on the net is highly recommended. 

Finally, we would like to notice that an online calculator applying this model is 
now under construction. Technically, this kind of online tool can be embedded in any 
existing databases (patent, bibliography, etc) to enable a full automatic evaluation 
process for research institutions and scientists around the world. An example with 
the scope of Indonesian scientific community is still under progress through the 
DBRIpTek database [T6ifT7j. 
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